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IMAGE COLLATING SYSTEM 



The present invention relates to an image collating system, 
and to an image feature extractor for extracting 

image features of a pattern image such, as a sldn pattern image 
represented by a fingerprint or a palm-print, an image feature analyzer 
for analyzing the image features, and an image matching system for 
verifying matching of the pattern image with those filed in a database. 

In the following description, the present invention is explzdned in 
connection with a sldn pattern feature extractor, a skin pattern feature 
analyzer cuid a skin pattern matching system applied to personal iden- 
"tification as representative examples of the above devices. However, 
it will be easily understood that the present invention can be widely 
applied to matching verification of other pattern images having certain features, 

and is not limited to the skin pattern matching verification. 

As a most orthodox art for identifying a skm pattern such as 
a fingerprint or a palm-print, there is known a matching verification 
method maldng use of feattire points of the fingerprint called the minu- 
tia matching which is disclosed in a Japanese Patent entitled "Fm- 
gerprint Collation System" pubhshed as a specification No. 63-34508. 

However, a disadvant^ of the mlnutia matching is that it takes a lot of 
computatioucxl time because of a large amoimt of data to be processed. 

Cre method proposed to overcane the aforesaid disadvantage is a technique for reducing 

a number of candidates to be verified by way of the Ten Print Card, 
which is disclosed in "Fingerprint Card Classification for Identification 
with a Large-Size Databcise" by Uchida, et .id?, TechnicMv.R^^ of 
lEICE (The Institute of Electronics, Information tmd Comihitnication 
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Engineers) PRU95-201 (Jan. 1996). In the Fingerprint Classification 
of this technique, a high-speed rough matching is performed referring 
to certain features such as the basic fingerprint classification category, 
distances between singular points, namely, cores or deltas, etc., for pre- 
5 selecting candidates to be verified with the minutia matching. As the 
basic fingerprint classification categories, the fingerprint pattern of each 
finger is classified into a basic category, such as the 
Whorl, the Right Loop, the Left Loop or the Arch, and the number of 
ridge linens and the distances between cores and deltas of each finger 
10 are extracted . - together with their confidence -values, 

and used in the rough matching technique. 

The snxDunt of data ag!=a^Tai-^ with these features is at nest several hundred bytes 
for a card, fcir smaller than the severed thousand bytes necessary for 
the minutia matching. The smaller data amount, and consequently the 
15 smaller cidculation amoimt enable a high-speed fingerprint verification. 
Tlris by reducirig ths nurrber of candidates before the minutia matching is perfonned, 
the pre-selection technique of the prior document by Uchida et al. 
enables the total cost performance of the fingerprint verification 
system its a v*oie to be imnroved. 
20 However, because the deltas are usually found in edge parts of 

th(; fiug<;rpriut, the numbers of ridge lines and the distmices between a 
core and a delta are often difficult to be extracted when a so called roll 
printing is not performed correctly. The roll printing means here to 
ti±e the fingerprint pattern by pressing a fingertip roUing on a card, as 
25 usually performed when the poHce take the fingerprint. Furthermore, 
the above techniciue is not efficient to pre-select the Arch patterns 
which have no delta. 
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Therefore, methods for improving pre-selection performcince have 
been sougiit. One promising solution is to find other appropriate fea- 
tures to be used for the rough matching in place of or in addition to the 
ab()V(* f(?Htur(\s. Oik* of th(* possibh; features is the dir(H;tion [)Httern of 
fingerprint ridge lines. "Personal Verification System with High Toler- 
axLce of Poor Quality Fingerprints" by Sasagawa et al., the transactions 
of lEICE D-II,' Vol, J72-D-II, No. 5, pp. 707-714, 1989, is an example 
of usage of the direction pattern to the rough matching. 

Features wit±i dixnensicns , such as the direction pattern 

of the fingerprint ridge lines, makes . the high- 

speed matching verification difficult. Iberefore, who^ evaluatUng such features, 

it is necessary to find a feature extraction method enabling to 
extract a condensed feature f\jnctLcn or value having -sn apprcpriate dimensicn 

size giving good results sufficient efficiency at the same 

time. A well-known method of such a feature extraction is the prin- 
cipal component cuialysis. An example of the method applied to the 
direction pattern of the fingerprint ridge hnes is described in a paper of 
C. L. Wilson et ah, entitled "Massively Parallel Neural Network Fin- 
gerprint Classification System", NISTIR 4880, 1992, Jul, pubhshed by 
National Institute of Standards and Technology. 

In the method of C. L. Wilson et cd., the direction pattern is 
processed cis follows, 

First, training data of N fingerprint images are prepared. Then, 
defining feature vectors composed of ridge directions each representing 
local fiow of ridge lines, the principal component analysis is performed 
for distribution <^f the fe<iture vectors to obtain principal component 
vectors having larger eigenvalues. Using the principal component vec- 
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tors thus obtained, Karhimen Loeve Transform (hereafter abbreviated 
as KLT) of the feature vector of an objective fingerprint image is per- 
formed, whereof feature values of upper dimensions are extracted ss 
the cond<uiscd feature vahie. 

In the following paragraphs , more details of the feature extraction 
using the KLT are described. 

For the first, a vaxiaiice-covariance matrix V is calculated as fol- 
lows from feature vectors Ui (i = 1 to N) of the N fingerprint images 
prepared for the trcvining. 

V = -^Y:{^i-u){u,-uy (1) 

Here, the feature vectors Ui are column vectors of M dimensions, 
u is a me<m vector of and the upper suffix ^ means a ti-anspose. 

Eigenvalues of the variance-covariance matrix V being represented 
by ('i = 1, M; A, > A^+i), eigenvectors corresponding to the 
eigenvahies Ai are represented by iP'.-. These eigenvectors are the 
principal component vectors and one corresponding to a largest eigen- 
value A i is called a first principal component vector, followed by a 
second, a third, . . ., a M-th principal component vector in the order 
of corresponding eigenvalue. 

For a feature vector u of an objective fingerprint image, which is 
not us(.'d for the training, projection of the feature vector u to a partial 
space defined by one or more primary (corresponding to kugest eigen- 
valiuis) principal component vectors is calculated, that is, projection 
components Vi around the mean vector u are obtiiined iis follows: 

The projection components vi thus obtained are the feature values 
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extracted by way of the KLT. 

In C. L. Wilson et al., a feature vector composed, cls its com- 
ponents, of primary projection components Vi corresponding to the 
primary iirincipal componcuit vc-ctors is input to a neural network for 

5 the fingerprint classification. However, these extracted feature values 
are used only for the classification and aiiy application to the matching 
verification is not taught therein. 

Although it is not applied to the sldn pattern analysis, there is de- 
scribed iui exiimple of a faciei! image matching verification maldng use 

IQ of feature values obtained by the KLT, in "Eigenfaces for Recognition" 
by A. Pentland et al., MIT Media Lab Vision and Modeling Group, 
Technical Report #154 and also in "Probabihstic Visual Learning for 
Object Detection" by B. Moghaddam iind A. Pentland, pp. 786-793 of 
Proceedings of the 5-th International Conference on Computer Vision, 

2^5 1995. In these two d(>cuments, a method of facial image matching ver- 
ification is described, wherein a vector consisting of each pixel value of 
a facial image as each component thereof is used as the source feature 
vector, and the facial matching verification is performed according to 
Euchdeiui distimce.or Mahalaiiobis distance of the condensed feature 

20 vector extrticted by way of the KLM of the source feature vector. 

However, these prior arts have their disadvantagss viToi applied tn the 
fingerprint matching verification. 

By Uchida et al., it is often difficult to extract sufficient features 
such as distances or numbers of ridge hnes between the core and the 

25 delta when the rotation stiiniping is not performed correctly because 
the deltcis are usually found in edge parts of the fingerprint. Fur- 
thermore, the Arch patterns having no delta cannot be pre-selected 



B^4SDOCID; <GB 2320352A I > 



-6 - 



sufficiently. 

In C. .L. Wilson et al., there is a description concerning finger- 
print feature extraction making use of the KLT applied to fingerprint 
classification, but no description concerning application thereof to the 
fingerprint matching verification is used, for exanple, to pre-select tie 
verification cajididates, as intended in Uchida et al. 

Although not to the fingerprint matching verification, application 
of the KLT to facial image matching verification is disclosed in the doc- 
uments of A. Pentland et al. The fingerprint image may be processed 
according to Euclidean distances or Mahalanobis distajices in the same 
way with the above method of A. Pentland et al. However, many of 
the cvvculable fingerprint images are of fairly low gTade and sufficient 
reliability cannot be expected with such a simple method as that of 
A. Pentland et al., relying simply upon the condensed feature vector. 
The refuse )u is that necessary consideration is not pciid to confidence of 
the extracted features there. 

It is the same with Uchida et al., wherem the distance between 
pattern images is defined with a feature value and a confidence value. 
However, the confidence value is calculated heuristically and there is 
given no logical evidence. 

Therefore, a primiuy object of the present invention is to embody 
a matching verification architecture for efficiently identifying pattern 
images such <is skin patterns by resolving the above problems, and 
to provide an image feature extractor, an image feature analyzer and 
an image matching system, wherein a high-speed and a high-precision 
processing is realized. 

First, the principle of the inveitlcn will be explained. 

A_l_> 
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WLen two feature vectors eire given, a variety of distances can 
be defined between the two feature vectors. As examples thereof, fol- 
lowing Euclidean distance, weighted Euclidean distance, Mahalanobis 
distance, etc., iii-c introduced in pp. 652-658 of "HcUidbook of Image 
Analysis" by Takagi et al., Tokyo University Press, 1991. 



n 



Euclidean distance D{x, y) = Yli^i ~ Vi)^ (4) 

n 

weighted Euclidean distance D(x, y) = ^ Yl '^^ii^i — Vi)^ (5) 

Mcihalanobis distance D{x^ y) = ^(x — yyV~^(x — y) (6) 
10 where, Xi and r/i are respective components of the two feature vectors x 
and y both having n dimensions, lUi is a corresponding weight factor, 
and V is a varieince-covariajice vector of distribution of the feature 
vectors. 

Among them, the Mahalanobis distance is Icnown to give a most 
15 natural distance when the feature vectors accord to normal- distribu- 
tion. 

When the two feature vectors x and y are vectors obtained by 
the KLT, above ecjuation (6) can be represented as follows, which is 
described also i n the documen ts of A. Pentland et al. 



20 D{x,%j) — 



^-^^ir^ (7) 



where, A,- are eigenvalues of the variance-covariajice vector V. A set of 
eigenvahies A,- is defined for a distribution of whole feature vectors or 
for each of distributions of respective cliisses of the feature vectors. 
As shown by above equation (7), the Mahalanobis distance of the 
25 feature vectors obtained by the KLT needs no matrix operation. It 
can be calculated with a simple square sum operation compatible to 
equation (5), enabling to reduce computationcil time. 
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Suppose, here, to cLossify the feature vectors into classes C{Q) 
according to their feature values Q, the feature values Q (hereafter 
called the quaUty indexes) being values having correlation with errors 
of respective feature vectors. To clarify relation between the quality in- 

5 dex and the distance used for discriminating a feature vector, different 
condensed feature vectors, obtained from a specific object image and 
having their respective quahty indexes Q, are considered. Assuming 
these condensed feature vectors have been processed through the KLT 
mciking use of vivricmce-covaricuice matrix of distribution of source fea- 

10 ture vectors, and representing variance among i-th components of the 
condensed feature vectors classified into each class C(Q) by XiCiQ), 
the Mahalanobis dislance between two condensed feature vectors x and 
y belonging to a specific class C{Q) is expressed as follows: 



A i^i - ViY (8) 
15 'Here, Xi{C[Q)) gives an error variance among the feature vectors 
since it is a variance of distribution of the feature vectors obtamed from 
the same specific object image, provided that the distribution of the 
feature vectors of the class C{Q) accords to a normal distribution and 
the eigenvector of the varitmce-covariance matrix of distribution of the 
20 clcuss C{Q) is the simic with the eigenvector of the variance-covaxiance 
matrix applied to the KLM. 

Now, a case is considered wherein the quality index Q and the 
error variance \i[C{Q)) have a correlation expressing that the better 
quality index makes the smaller the error variance ius illustrated in 
25 FIG. 22 (wherein the correlation is represented by that of an i-th. di- 
mension), and two different featiure vectors x and y, whereof a distance 
is calcidated, have a common quahty index. 
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R.(;i)r(;senf.ing the common qucility index by of FIG. 22 and 
correspbiiding error variance by ^A,-, a distance Di{x,y) between the 
two feature vecto rs is calculate d as follows: 
Di{x,y) = 



E (9) 



while another distance D2(x,y) between the same feature vectors x 
and y is calculated cis follows when they have another common quality 
index ^Q: 

D2{x,y) = 



{Xi - IJi)'^ 



Here, it is noted that a relation Di{x,y) < D2(x,y) stands when 
the error variance of each z-th dimension has a relation ^A^ > '^A^. It 
means that the Mahalanobis distance varies adaptively to the Ci\iality 
index so as to give a small distance difference estimation when having 
a poor quality index, that is, giving large error variances ^A,-, and a 
large distance diffcorence estimation when having a good equality index 
to the same two feature vectors x and ?/, Euclidean disteuice thereof 
being constant. 

The fact that the distaaice varies adaptively to the quality index is 
significant, since thereby incorrect rejection because of data extracted 
from low grade images can be effectively reduced. 

In Uchida nt al., beforehcind described, precision of feature ex- 
traction is reflected to a dist^mce value by defining the distance value 
according to the confidence value (which is heuristically calculated a^ a 
value reflecting the feature extraction precision). However, the distance 
value is defined by a product of the confidence vaJue and a difference 
between two feature vcilues each belonging to each entirely different di- 
mension, which can be said to be the same thing to define the distance 
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value by multiplying the height with the weight. Therefore, there is 
no statistical or theoretical guarantee of precision improvement, even 
if some good results may be obtained. 

On the othc-!!- hand, by converting the quality index (which can be 
siud to be the confidence) into each error variance among components 
of respective dimension of the feature vectors as above described, a 
measure of distances having the same dimensions with the feature vec- 
tors ccxn be defined. The Mahalanobis distance is one of the distances 
which can be defined with statistical support, although there are some 
restrictions such as the assumption of the normal distribution. 

A good discrimination performance can be thus obtained by defin- 
ing a distance viilue supported statistically. 

Heretofore, a distance between two different feature vectors is de- 
-Scribed. This is to explain a fact that a strict value of the Mahalajiobis 
distances, which hius a statistical" significance, can be obtmned concern- 
ing feature vectors of a specific object, by assiuning a normal distribu- 
tion of the feature vectors. However, the essential merit of the above 
quality index does not he in defining the strict Mahalanobis distance 
itself, but in reflecting correlation between the quaUty index shown 
in FIG. 22 and the error distribution of the feature vectors onto the 

distcmce definition. 

The Mahalanobis distance, which is adaptive to the above quality 
index, can be obtained by calculating error distributions of different 
feature vectors in each chiss obtained from a specific object and sorting 
them according to their quality index. However, calculation of such 
vcUues is apphcable only to such a special matching verification wherein 
few objects are treated and only confirmation of identity thereof is 
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discussed. 

For specifying an iinlcnown object, such as intended in the remain- 
ing fingerprint verification performed in the criminal investigation, the 
above distance definition is inappHcable. A distance between feature 
5 vectors obtained from different objects should be defined, too. 

For the purpose, a distance value which will be described in the 
following pciragraphs cem be defined, for example. 

A most significant object of the distance definition is to reflect a 
quality index, or a confidence, to the error distribution. Hence, foUow- 
IQ ing three cissumptions 1. to 3. are apphed to the distance definition, 

1. The errors included in a feature vector are dependent on its' 
ciuaJity index and independent of the feature vector itself. 

2. A distribution of the errors jncluded in feature vectors accords 
to a normal distribution. 

15 3. Errors corresponding to a difference between two feature vectors 

C'cui he estimated from the errors included in each of the two featiure 
vectors. 

On the three cissumptions, a Mahalanobis-hke distance function 
D{x^ y) is defined as foUows. 
20 D{x,y) = 



25 



A, = ^A, + ^A,- (12) 
Here, "^A,- and ^A,- are variances of the error distributions, depend- 
ing on the quality index, of components Xi and jji of the respective 
feature vectors x and t/, and A; represents an estimation of errors cor- 
responding to Xi — yi. The error variances "^A,- and '-^A,- can be prepared 
through an excimination of respective inter-relations such as illustrated 
in FIG. 22. 
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Further, the ordinary Mahalanobis distance is said to have a prob- 
lem that its discrimination performtuice is degraded in a range where 
eigenvahies (A,) are small becaiise its susceptibihty to noises (for exam- 
ple;, iu "A Handwritten Character Recognition System Using Modified 
Mahalanobis Distance" by Kato et al., the transactions of lEICE D- 
II, Vol. J79-D-II, No. 1, pp. 45-52, 1996). Therefore, the distance 
fimction may be defined by way of following function. 

X, = -Ai-F^i (15) 
Here, « represents a set of differences among feature vectors ob- 
tained from a specific pattern, and P{di\a) represents a cUstribution of 
the differences in the set,_namely, the error distribution. On the other 
hand, P is a set of differences among feature vectors obtained from 
whole patterns, and P(di|/3) is a distribution of the differences among 
feature vectors therein. 

When the distribution functions P{di\ct) cmd P{di\P) accord to 
the norniiU distribution, they tire calculated as follows, firstly. 



72 



where A,-,,, and A^,;, are variances of respective distribution functions 

P{di\oc) and P{di\P). 

Then, from these distribution functions, the distance function of 

2^ the equation (13) can be developed as follows. 

I)(x,y) = 1 )dJ + i:(logA,.-lo6A,,) (18) 
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Therefore, a MaJialanobis-like distance function such as defined 
by equation (11) can be composed by obtaining square root of the first 
term in the right side of equation (19). Difference between the two dis- 
tance functions is that a weight factor (-r t^) is attributed to each 

dimension of tke feature vector, in the equation (19). The weight factor 
is determined according to the error distribution relative to the distri- 
butifm of the wliole patterns. When the error distribution is sufficiently 
sniciU compared to the whole pattern distribution, the weight factor 
becomes large, attaching much importance to corresponding dimen- 
sion. On the contrary, the error distribution is equivalent to the whole 
pattern distribution, the weight factor becomes small, corresponding 
dimension being relatively neglected in effect. Thus, an effective result 
Ciin he obtiiined with the distance function of equation (19) even from 
feature vectors including components giving small eigenvalues A^-, that 
is, susceptible to noises. 

Heretofore, the principle of the invention whereon the embodi- 
ments are bcised is described mainly in connection with feature values 
obtcuned through the KLT. This is to claxify statistically and theo- 
reticcdly the effectiveiess of the invention, v*ierein an error distribution is 
obtained according to the quality index and reflecting the matching 
verification. 

However, application of this invention is not necessarily Umited to 
the featiu'e values processed by the KLT. The most important essence 
of the invention lies in providing an architecta^ which enables matching verification 

between two image patterns taking in consideration of their 
confidence, referring to errors of feature values, the errors being adap- 



BNSCOCID: <GB 2320352A_1_> 



m m 

- 14 - 



tively rneiusiired according to quality index of the image pattern. 

In order to embody the matching verification aichitectuie based 
on the above principle, an image feature extractor of the invention, for 
outputting a feature information data set of a pattern image including 
data of a feature vector of the pattern image and confidence estimation 
information of the feature vector attributed to each component of the 
feature vector, comprises; 

a feature vector extraction means for extracting the feature vector 
from the pattern image; 

a quahty index extraction means for extracting quality index in- 
formation of the pattern image; 

an error distribution information storing means wherein error dis- 
tribution information is prepared, the error distribution information 
representing correlation between error distribution of a plurality of fea- 
ture vectors extracted by the feature vector extraction means and the 
quality index information extracted from the quahty index extraction 
means corresponcUng to the plurahty of feature vectors; and 

a confidence attribution means for obtaining confidence estimation 
information referring to the error distribution information prepared in 
the error distribution information storing means by way of the quality 
index information extracted from the pattern image by the quality 
index extraction means. 

An image feature analyzer of the invention, for obtaining the er- 
ror distribution information to be prepared in the error distribution 
information storing means of the image feature extractor, comprises: 

a feature vector extraction means for extracting the plurality of 
feature vectors from pattern images; 
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a quality index extraction means for extracting the quality index information from 
the pattern images; and 

a error distribution information analyzing means for calculating the error 
distribution information from distribution among each feature vector set of the plurality 
of feature vectors and a value of the quality index information of each feanire vector 
belonging to the each feature vector set, said each feature vector set con5>rising feature 
vectors extracted more than one pattern images of a same pattern. 

An image feature collating system of the invention for determining the extent of 
ectypography between pattern images making use of the feature information data set of 
the pattern image con:q>rises: 

a database section wherein the feature information data set of each of a plurality 
of pattern images is registered; and 

a matching section for preforming matching verification of the pattern image by 
discriminating accordance/discordance of the feature information data set registered in the 
database section according to distance between two feature vectors each included in 
respective feature information data set calculated in consideration of the confidence 
information of the two feature vectors. 

A system for collating images according to another aspect of the invention 
con5)rises means for deriving a feature value for the features of each image; means for 
deriving a quality index value for the features of each image; means for determining 
errors for the feamre values in which said errors are adaptively measured according to 
the quality index of the features of each image; and means for determining the extent of 
ectypogrjphy between features of each image. 

In a further aspect, the invention provides a method for collating images 
con5)rising the steps of determining feature values for image features; deriving quality 
index values for image features; determining the extent of ectypography between each 
unage by considering the confidence between the features of each image and referring to 
the errors for the feature values for the two images wherein said errors are adaptively 
measured according to the quality index of the features of the images. 

Therefore, a high-speed and a high-precision method of determining the degree 
of ectypography between image features can be realized by the image collating system 
of the invention. 

The foregomg, further objects, features, and advantages of this invention will 
become apparent from a consideration of the accompanying drawings by way of exaii5)le 
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In the drawings:, 

FIG. 1 is a block dicigram illustration a first embodiment of the 
skin patt(;rn matching system according to the present invention; 

FIG. 2 is a pattern chart illustrating an example of a set of the 
ridge directions; 

FIG. 3 is a block diagram illustrating a configuration of the quality 
index extraction means 106 according to the example for obtaining the 
quality index from the confidence of ridge direction; 

FIG. 4 is a schematic diagxam illustrating data table prepared in 
the error distribution information storing means 105; 

FIG. 5 is a block diagram illustrating a first embodiment of the 
skin pattern feature analyzer according to the invention; 

FIG. 6 is a flowchart illustrating processes performed in the skin 
pattern feature analyzer 51 of FIG. 5; 

FIG. 7 is- a graphic chiurt illustrating an analysis result of the skm 
pattern feature analyzer of FIG. 5; 

FIG. 8 is a schematic diagxam illustrating a featiure vector X, 
originixlly to be in the closed space CI when there is no noise, extracted 
iis tuiother feature vector O, 

FIG. 9 is a block diagxam illustrating a quality index extraction 
means 90 according to the second embocUments; 

FIG. 10 is a flowchiirt illustrating processes performed in the qual- 
ity index extraction means 90 of FIG. 9; 

FIG. 11 is a schematic diagram illustrating 1-dimensional error 
distribution table applied to the second embodiments; 

FIG. 12 is a gxaphic chart illustrating an experimental result of 
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the error distribution table of FIG. 11; 

FIGTlS is a block diagram illustrating a configuration of the equal- 
ity index extraction means 130 according to the third embodiments; 

FIG. 14 is a flowchart ilhustrating processes pcirformed in the qual- 
5 ity index extraction means 130 of FIG. 13; 

FIG. 15 is a block diagTcim illustrating the fourth embodiment of 
the sldn pattern matching system of the invention; 

FIG. 16 is a schematic diagram for explaining principle of the fifth 
embodiment; 

IQ FIG. 17 is a block diagTam illustrating a feature vector extraction 

means of the fifth embodiment; 

FIG. 18 is a schematic diagram illustrating samphng operation of 
of the sfunpling means 1704 of FIG. 17; 

FIG- 19 is a bloclc diagxam illustrating a basic configuration of the 
15 sixth embodiment of the skin pattern matching system; 

FIG. 20 is a block diagTean of a fourth embodiment of the sldn 
pattern featiure analyzer of the invention; 

FIG. 21 is a schematic diagxeim illustrating a palm pattern; and 
FIG. 22 is a schematic cUagram illustrating inter-relation between 
20 error variaaice and ciuality index. 

Now, embodiments of the present invention are described in con- 
nection with the drawings. The description will be made in connection 
with a skin pattern feature extractor, a sldn pattern feature analyzer 
and a skin pattern matching system apphed to personal identifica- 
25 tion cis representative examples of the embodiments, namely, an image 
feature extractor, an image feature analyzer and an image matching 
system, '<xs previously premised. 
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In thii following paragraphs some embodiments of the skin pattern 
matching system and the skin pattern feature analyzer are described. 
As to the skin pattern extractor, it is described as a section, a feature 
extraction sf^ction, of the skin pattern matching system, since the skin 
5 pattern feature extractor is to be used as an element of the skin pattern 
matching system. 

FIG. 1 is a block diagram illustration a first embodiment of the 
sldn pattern matching system according to the present invention. 

Referring to FIG. 1, the skin pattern matching system of the first 
IQ embodiment hcis a feature extraction section 11 for extracting feature 
data from a sldn pattern image, a database section 12 for managing a 
databiise storing the feature data extracted by the featiure extraction 
section 11, a matching section 13 for performing matching verification 
of feature data extracted by the feature extraction 11 of an image to 
"l5 feature data registered in the databiise section 12, and a control section 
14 for controfling each element of the sldn pattern matching system. 
(Here, in the drawings, control lines connecting the control section 
14 with each element is not depicted for simplification.) The feature 
<;xtra(:ti(»n .soictiou 11 (■orrc^sixinds to the .skin pattern feature- extractor 
20 to be claimed. 

The feature extraction section 11 comprises; 

?m image input me<ms 101 where image data of a sldn pattern such 
as a fingerprint or a palm print are input, 

a feature vector extraction means 102 for extracting a feature vec- 
25 tor from image data input through the image input means 101, 

a vector transfer means 103 for generating feature information by 
performing the KLT of the feature vector extracted by the feature 
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vector extraction means 102, 

a principal component vector storing means 104 wherein princi- 
ple component vectors corresponding to feature values of the feature 
v<)ct()rs nro i>rcparcd to hr. used for the KLM performed in the vector 
transfer means 103, 

an error distribution information storing means 105 wherein is pre- 
pared error distribution information representing correlation between 
the feature values cind cxuality indexes, 

a cj[Urility index extraction means 106 for extracting a quality index 
of the image data input through the image input means 101, and 

a confidence attribution means 107 for attributing confidence in- 
formation to the feature informcition generated by the vector transfer 
means 103 according to the qucdity index extracted by the quality in- 
dex extraction means 106 referring to the error distribution information 
prepared in the error distribution information storing means 105. 

The feature information generated by the vector transfer means 
103 and the confidence information attributed thereto by the confi- 
dence attribution means 107 are the feature data extracted of the image 
data to be output from the feature extraction section 11. 

Th(^ database section 12 comprises; 

a data storing means 109 wherein a plurality of feature data sets 
extracted by the feature extraction section 11 are registered, imd 

a database management means 108 taking charge of reference or 
registration of the plurality of feature data sets in the data storing 
means 109. 

The matching section 13, which performs the skin pattern match- 
ing verification for outputting matching results, comprises; 
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ix similarity calculation means 110 for calculating a similarity of 
the fe<ituie data supplied from the feature extraction means 11 to each 
of the pluraUty of feature data sets registered in the databcise section 
12, and 

a determination means 111 for determining accordance/discor- 
dance from the similarity calculated by the similarity calculation means 
110. 

Now, operation of the skin pattern matching system of FIG. 1 is 
described along with an example wherein the sldn pattern matching 
system is applied to a fingerprint matching verification. 

First, procedure in the feature extraction section 11 is described. • 
The image input means 101 obtains digital 2-dimensional image 
data of a fingerprint pattern by way of a scanner, a CCD (Charge 
Coupled Device) camera or the like. It may be configured to obtain 
th(; fingerprint image data through a public network from a remote 
terminal. Here, the fingerprint image data axe cissumed to be image 
data having 512 x 512 bmary pixels talcen with a resolution of 500 DPI 
(Dots Par Inch). 

The feature vector extraction means 102 extracts a feature vector 
from tliv lingi^rprint imagd data input through tht; imcigc input mciuis 
101. There can be considered various features to be extracted for the 
feature vector, beginning with the ridge cUrection, the ridge Une pitch 
and so on. In this example, focusing on the ridge direction feature, the 
feature vector is described to be extracted making use of an "Apparatus 
for determining ridge line direction patterns" disclosed in a Japanese 
patent application laid open as a Provisional Pubhcation No. 7097/'96. 

Here, the fingerprint image data input by the image input means 
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101 arc represented ^is f{x,y), x and y being horizontcd and vertical 
coordiniites thereof having integer values from 1 to 512. With the 
apjjarattis of the Provisional Publication No. 7097/'96, a ridge direction 
0{C) having a value 0 < 0{C) < tt cau be extracted for each sub-region 

5 C defined in the image data f{x,y). In an example, 256 sub-regions C 
{C — 1, 2, . . 256) are defined horizontally and vertically at every 32 
pixels in a set of image data of 512 x 512 pixels. 

FIG. 2 is a pattern chart illustrating axi example of a set of the 
ridge directions thus extracted, wherein the ridge direction and its 

10 confidence of each sub-region are represented by direction and length 
of each corresponding segment, respectively. When the ridge direction 
is expressed by such an ajigie value from 0 to tt as in the Provisional 
Publication No_ 7()97/'95, a discontinuity iirises between (9 = tt and 
d = 0, which is inconvenient for the feature vector. Therefore, the 

15 ridge direction 0{C) is converted into vector components Ux(C') and 
u,j{C) according to following equations. 

U:,{C) = cos(2^(C)) (20) 

Uy{C) = sin(2(9(C)) (21) 
Thus, a following feature vector u having 512 dimensions consist- 
20 ing of the vector components Ux{C) and iCy{C) of every sub-region C 
is output from the feature vector extraction means 102 of FIG. 1. 



25 
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The vector transfer means 103 performs the KLM of the feature 
vector u extracted by the feature vector extraction means 102 accord- 
mg to principal component vectors prepaxed in the principal compo- 
nent vector storing means 104. As for the principal component vectors, 
outputs of a first embodiment (which will be described afterwards) of 
the skin pattern feature analyzer may be prepared in the principal com- 
ponent vector storing means 104, for example. Here, consider there are 
prepared L principal component vectors iZ^,- (z = 1, 2, . . Z/). Each of 
the principeil component vectors has the same dimensions with the 
feature vectors u <md expressed a^ a column vector. 

The vector transfer means 103 calculates the KLT of the fea- 
ture vector u for each z-th of the L principal component vectors 
according to following equation from the feature vector u and the prin- 
cipal component vector iP^,-. 



Thus, a following condensed feature vector v is obtained from the 
source feature vector u through the KLT. 



(23) 
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fvi\ 



V = 



(24) 
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As will be described in connection to the first embodiment of the 
skin pattern feature analyzer, sufficient precision can be attained with 
a small number (five, for example) of principal component vectors, 
which defines the dimension number L of the condensed feature vector. 
The condensed feature vectors of five dimensions enables to reduce 
data amount into about 1/100 of the source feature vector having 512 
dimensions of ridge direction features. 

In ciiise where a mean vector u is cdready prepai-ed by calculating 
mean vcilue of the plurality of sample feature vectors the previous 
described equation (3) may be applied instead of above eciuation (23) 
for performing the KLT of the source feature vector u. 

The quality index extraction means 106 extracts the quality index 
through following procedure. 

The quality index may be represented by any data, provided that 
the data have correlation with errors included in the feature vector 
n. Here, Ccdculation of the ciuality index rncildng use of the confidence 
value discussed also in the prior apparatus of the Provisional Pubhca- 
tion No. 7097/^96 is described by way of example, which is obtained 
along with determining the ridge direction. 

FIG. 3 is a block diagram illustrating a configuration of the quality 
index extraction means 106 according to the example for obtaining the 
quality index from the confidence of ridge direction. 

The quality index extraction means 106 comprises a ridge direc- 
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tion confidence extraction means 301 for extracting the ridge direction 
confidence from input image data 31, a second principal component 
vector storing means 302 for storing principal component vectors, and 
a data conversion means 303 for generating quality index data 32 from 
the ridge direction confidence extracted by the ridge direction confi- 
dence extraction means 301 and the principal component vectors stored 
in the principal component vector storing means 302. 

The ridge direction confidence extraction means 301 calculates 
a confidence value q{C) of ridge cHrection 6{C) of each sub-region, 
making use of eigenvalues of variance-covariance matrix of a.gTadient 
vector of concerning sub-region C in the same way as disclosed in 
the Provisional Publication No. 7079/'96. As beforehand premised, 
the ciUciHty index may be calculated in aoiother way, and complicated 
description is omitted, here. Furthermore, the prior apparatus of the 
Provisional Publication No. 7079/ '96 outputs the confidence value q{C) 
together with the ridge direction Q{C). Therefore, the feature vector 
extraction mectns 102 of FIG. 1 may be included in the ridge direction 
confidence extraction means 301, 

In the second principal component vector storing means 302, the 
Scime L principivl component vectors with those stored in the principal 
component vector storing means 104 are prepared. Hence, the principal 
component vector storing means 104 in the feature extraction section 
11 may be commonly referred to by the data conversion means 303 
instead of the second principal component vector storing means 302. 

The data conversion means 303 calculates equality index values Qi 
from the confidence value q{C) and the principal component vectors 
iPt according to following equation. 
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Qi = ^T,Q{Cr^UCr (25) 
Here, ^^i(C) represents C-th component of i-th principal compo- 
nent vector 

Thus, L quality index values Qi corresponding to L principal com- 
ponent vectors iP", are calculated for a set of image data 31. As the 
quality index data 32, the data conversion means 106 outputs a follow- 
ing ciuality vector Q consisting of the L quaHty index values Qi as its 



components- 

fQi\ 



(26) 
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In the error distribution information storing means 105, error dis- 
tribution information, which is also calculated by the first embodiment, 
for example, of the skin pattern feature analyzer to be described af- 
terwards, is prepared. In the first embodiment, a standard deviation 
<^{vi\ Qi) of each component v,- of a condensed feature vector v is cal- 
culated when a corresponding component Qi of the quality vector Q, 
corresponding to the condensed feature vector v, is given. 

FIG. 4 is a schemtttic diagr^vm illustrating data table prepared in 
the enor distribution information storing means 105. 

Referring to the data table in the error distribution information 
storing means 105, • the confidence attribution means 107 outputs a 
following confidence vector a by calculating a standaid deviation value 
corresponding to the ciuahty vector Q supplied from the Cjuality index 
extraction means 106. For example, when a first component Qi of the 
quaUty vector Q has a value in a range or, < Qi < a-z, the data table 
of FIG. 4 is retrieved and a standard deviation value cri,2 is output. 
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In the same way, a certain standard deviation value, denoted by a,-, is 
output for. every quality component Q,-. Thus, a following confidence 
vector <T is obtained from the confidence attribution means 107. 



<r = 



(27) 



Secondly, procedure performed in the database section 12 is de- 
scribed. 

The database section 12 talces charge of data recording controlled 
10 by the control section 14 or data reading to be delivered to the matching 
section 13 upon referring request. 

Controlled by the control section 14, the database management 
means lOS.registers the feature vector v and corresponding confidence 
vector <r in the data storing means 109 together with data management 
15 information thereof such as data ID (IDentifi cation). 

As for this data storing means 109, a semiconductor memory such 
as a DRAM (Dynamic Random Access Memory) and data recording 
media such as a hard disk device are used. 

In conventional fingerprint matching systems, it has been hardly 
20 possible to prepare aU the necessary data in a DRAM in econom- 
ical view, because of their enormous data amount. (According 
to a method described in "Automated Fingerprint Identification by 
Minutia-Network Feature - Matching Processes -" by Asai et al., the 
transactions of lEICE D-II, Vol. J72-D-II, No. 5, pp. 733-740, 1989, 
25 for example, data for one finger amount up to 1000 bytes.) Further, 
(;v(!n if th(; nc<:(;.s.siuy data may be deployed in a DRAM for high-speed 
processing, data transfer of large amount of data would have become 
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another bottleneck in most case. 

However, according to the skin pattern matching system of the 
embodiment, or the present invention, the condensed feature vector v 
and the confidence vector cr do not amount but only to 10 bytes par 
finger even when five dimensions of one byte are considered for each 
vector. Therefore, a data storage of lOOM bytes becomes sufficient 
for storing data of 10 million (10^) fingerprints, enabling to deploy all 
the necesscU*y diita in a high-speed accessible semiconductor memory, 
a DRAM, in the datci storing means 109. The hard disk is used here 
in par^Jlel to backup the DRAM agcdnst incidents. A semiconductor 
disk, n2imely, a nonvolatile memory such as a flstsh memory, may be 
applied instead of the combination of the DRAM and the hard disk 
device. 

When registered data are referred, to, the database management 
means 108 sends each pair of the condenced featiu'e vector v cind the 
confiden<;e vector cr to the matching section 13. 

Now thirdly, procedure in the matcliing section 13 is described. 

Controlled by the control section 14, the matching section 13 de- 
termines accordance/discordance of the data sent from the feature ex- 
traction section 11 to each data set dehvered from the database section 
12, and outputs data management information such as the data ID of 
delta sets regiuxled to have accordance with the data sent from the 
feature extraction means 11, as follows. 

The similarity calculation means 110 Ccdculates a similarity of a 
pair of the featiu*e vector cuid the confidence vector sent from the fea- 
ture extraction means 11 to those delivered from the databiise section 
12. In the following paragraphs, the feature vector cuid the confidence 
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vector from the feature extraction section axe denoted and cr^, 

respectively, wliile those from the database section axe denoted a^ v-^ 
and cr^, respectively. The similarity z{v^, v^, cr^ , c^) is calculated 
according to following equation. 

= i;(-^- 4-) (28) 

i^l \Crla ^ijJ Cxi<7t 

Here, and v{ represent respective components of the feature 
vectors v'' and and and a{ represent respective component of the 
confidence vector (t"*" and cr^ . 

The similarity z{v^, , cr^, cr^) is a scale of likeness and the 
10 smaller the similarity, the better the two feature vectors resemble. 

The similarity calciilation means 110 may calcidate the similarity 
as follows instead of above equation. 

= _ (29) 

i=l \cri,o (^i,pj yjai 
WIkoii calcnlatiug the similarity according to equation (29), com- 
putational time can be reduced by beforehand preparing inverse square 
root, l/fx'/"'^, of eiich element of both the matching confidence vector cr 
(from the feature extraction section) and the reference confidence vec- 
tor a- (from the database section 12). Equation (29) defines a distance 
when th(; error distribution function accords to Laplace distribution 
(according to a distribution function /(x) = exp(— a|:/;|)). The dual- 
exponential distribution is sometimes applied for estimating errors in- 
cluding certain amount of singular noises, and the equation (29) gives 
better discrimination results thiui the equation (28) when low grade 
images are treated. 

Returning to the above equations, a-,> and iue both parame- 
ters whereof viUues are predetermined. For determining the parameter 
vtilues, following example is an eiisy way to calcidate them. 
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Tliat. is, prepiiring A' (10 thousciuds, for example,) ptiiis of dif- 
ferent fingerprint images, each pair talcen from each of K different 
fingerprints, the feature vector v and the confidence vector cr of each 
image are calculated by the feature extraction section 11. Denoting 
respective vectors of a j-ih pair by v^'\ <t^'^ emd v***, cr**' [j — 1, 2, . . ., 
7v), the parameters cr,-p and cr, fl are calculated as follows. 

dr = A ' (30) 



10 



= T--r E E [di'" -EE (32) 
The determination means 111 selects ajid outputs information of 
the data which can be regarded to be coincide with the data supphed 
from the feature extraction means 11 cimong those registered in the 
15 database section 12. 

In the accumulation calculation performed according to the equa- 
tion (28) or (29) by the similarity calculation means 110, the calculation 
may be finished determining there is no coincidence when the distance 
accumulation attains to a certain threshold value. 
20 Thus, a fingerprint matching verification is performed in the skin 

pattern matching system of the embodiment. 

Now, the skin pattern feature analyzer is described. 
FIG. 5 is a block diagram illustrating a first embodiment of the 
skin pattern feature analyzer according to the invention. 
25 The sldn pattern feature cinalyzer is used for analyzing distribu- 

tion information among feature vectors extracted from a data set of 
sldn pcittern images, and outputs principal component vectors of the 
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feature vector distribution aiid enor distribution infonriation repre- 
senting error correlation between the quality indexes <md the feature 
vectors. 

Refojrring to FIG. 5, the slcin pattern feature analyzer 51 of the 
5 first embodiment comprises; 

a feature vector extraction means 501 for extracting a feature vec- 
tor from a skin pattern image, 

a principal component vector calculation means 502 for calculating 
principal component vectors of data distribution of the skin patter im- 
IQ ages represented by the feature vectors extracted by the feature vector 
extraction means 510, 

a principal component vector storing means 503 for storing prin- 
cipal component vectors obtained by the principal component vector 
extraction means 502, 
^5 - a vector tr^msfer means 504 for obtaining condenced feature vec- 
tors by i)erforming tlie KLT of feature vectors extracted by the feature 
vector extrciction means 501, 

a ciurvlity index extraction means 505 for extracting a quality index 
of the sldn pattern images, and 
20 an eiTor distribution information analyzing means 506 for analyz- 

ing correlation between error distribution of the quiility index informa- 
tion dehvered from the ciuality index extraction means 505 and that of 
the condensed feature Vectors transferred by the vector transfer means 
505. 

25 FIG. 6 is a flowchart illustrating processes performed in the skin 

pattern feature iuialyzer 51 of FIG. 5, comprising a training feature 
vector extraction step 601, a variance-covariance matrix data accu- 
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rniilation step 602, a data finisii cle termination step 603, an average 
vector/variance-coviiriiince matrix calculation step 604, principal com- 
ponent vector calculation step 605, a quality index calculation step 
606, a pair vector extraction step 607, a pair vector KLT step 608, a 

5 pair vector error calculation step 609, an error distribution statistics 
calculation step 610, a pair vector finish determination step 611, and 
an error distribution output step 612. 

Now, operation of the embodiment is described, along with pro- 
cesses performed for preparing the principal component vectors to be 

IQ used in the principal component vector storing means 104 and the error 
distribution information to be used in the error distribution informa- 
tion storing means 105 of FIG. 1, by way of example. 

_ A data set of sldn pattern images should be beforehand prepared 
for obtaining the principal component vectors and-the error distribu- 

15 tion informahion to be used for the sldn pattern matching system of the 
invention. Hero <dso, a data set of fingerprint images are described to 
be prepared, by way of exiunple, for obtaining above data concerning 
fingerprints to be used for the skin pattern matching system of FIG. 1. 
The data set is assumed to comprise data of N pairs (total 27V) 

20 <^f diff(U-iuit imagers of TV fingc^rprints. The better, the more number 
of pairs are apphed for obtaining the error distribution information, 
but pcurs more than 10 thouscuids give comparatively good results. 
The data set may be gathered by way of an image input device such 
an image scanner as mentioned in connection with the first embod- 

25 iment of the skin pattern matching system. However, a fingerprint 
databixs<.* published by US National Institute of Standards and Tech- 
nology (hereafter abbreviated cis NIST), the NIST Special Database 




14, for example, is available. For cutting out image data of 512 x 512 
pixels from those of the NIST database, image center thereof should be 
detected, whereof a method is disclosed in a Japanese patent pubhshed 
as a specification No. 271884/89, for example. 

Returning to FIG. 6, extraction of the principed component vectors 
(steps 601 to 605) is described firstly. 

At steps 601 to 606, 2A'' feature vectors are extracted from the 
data set of 2N fingerprint images, a vari^mce-covariance matrix of dis- 
tribution of the 2N feature vectors is calculated, and the principal 
component vectors are obtained from the variance-covariance matrix. 

As for obtaining the principid component vectors themselves, it is 
not necesscvry to prepare data set of paired fingerprint images. How- 
ever, it is economical to use the same data set for obtaining both the 
principal component' vectors and the error distribution information. 
Therefore, the principal- component vector calculation is described to 
bo pcrfijrmed with the 2N fingerprint images, in the following para- 
gTaphs. 

The feature vector extraction means 501 extracts M (512 in the 
exiunple) dimensioned feature vectors ii,- (i = 1, 2, . . ., 2N), each rep- 
resented by (Hiuiition (22), from th<; data sot of 2iVfingerpriut images 
(at step 601), in the same way as the feature vector extraction means 
102 of FIG. 1. 

The principal component vector extraction meiins 503 Ccdculates 
statistic data of the extracted feature vectors u, for obtaining a 
vai-iance-cov£uiance matrix V thereof represented by equation (1). 

For calculating the variance-covariance matrix V directly accord- 
ing to (Hiuation (1), an average vector u should be calculated first 
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by acaininlating each of 2N of tt,-, and then the vaiiance-covjuriance 
matrix V" should be calculated by referring to each u,- according to 
equation (1). Therefore, all 2 A'' of u, must be retained in a memory, 
or the feature vectors Ui should be extracted twice for each operation. 

By this reason, the principal component vector calcuhxtion means 
502 of the embodiment calculates the variance-covariance matrix V 
according to following equation (34). 

1 -IN 

^ = 2iV - 1 ^l^"^' " ~ (33) 

1 2N 

Yl ^t-^!- - uu^ (34) 



2N - 1 ti 

_ I 2N 

" = 27vS"' (35) 
That is, an ciccumulation of the M dimensional feature vectors Ui 

for obtaining the mean vector u, and another accumulation of M x M 

matrix UiU^j for obtaining first term i:?=i of left side of the 

15 above equation (34) are sufficient to be calculated at step 602. These 
accumulations am be accompUshed each time when an individual fea- 
ture vector Ui is extracted. Therefore, it is not necessary to retain all 
the feature vectors Ui at the same time or to extract them twice. 

After the steps 601 and 602 are repeated for the data set of ev- 

20 <Jry of thr. fiugiu print imagf\s (dctorminod at step 603), the; principjil 
component vector calculation means 502 calculates (at step 604) sec- 
ond term of left side of the equation (34) from the mean vector u thus 
accumulated, for obtaining the variance-covariance matrix V. 

Then, (at step 605) the principal component vector Ccdculation 

25 means 502 calculates the principal component vectors by way of prin- 
cipal component cuialysis of distribution of the feature vectors Ui with 
its variance-covciriance matrix V obtained at step 604. The principal 
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component, analysis is well known and briefly described in the previous 
paper of G. L. Wilson et al. An explanation thereof caji be also found 
in pp. 40-42 of the "Handbook of Image Analysis" previously referred 
to. 

M principal component vectors iP't {i = 1, 2, . .. ., M; called a first, 
a second, . . ., an M-th principal component vector, in order of sizes 
of corresponding eigenvalues) axe obtained from a variance-covaxiance 
matrix V of M x M dimensions. Upper several principal component 
vectors imiong them axe sufficient to be used for the KLM. An ap- 
propriate employment number may be determined experimentally by 
performing the matching verification experimenteilly using featiire vec- 
tors actually processed through the KLM. In the case of the fingerprint 
image, upper two principal component vectors have conspicuously good 
characteristic. Hence, upper 5 to 6 principal component vectors cor- 
responding to largest eigenvalues are sufficient to-be applied. Here, L 
prin(;ii>al component vectors itre cissurned to be selected. 

Returning to FIGs. 5 and 6, the principal component vector calcu- 
lation mecms 502 stores the L principal component vectors iP"/ (Z = 1, 
2, . . ., L) in the principal component vector storing means 503. 

Thu.s, extra<:tit)n of the L jnincipcil component vectors SP i is per- 
formed. 

Then, the error distribution <.uialy.sis is described referring to steps 
606 to 612 of FIG. 6. 

In the error distribution analysis, correlation between the error 
distribution and the quality index of paired condensed feature vectors, 
obtained from a data set of paired images and processed through the 
KLT, is calculated. As beforehand premised, the error distribution 
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analysis will be dojscribed to use the same data set of N pairs of fin- 
gerprint images used to obtain the principal component vectors ^i. 
However, it may be performed with cinother data set of sufficient num- 
ber of paired and different fingerprint images, each pair thereof talcen 

5 from a same finger. 

At steps 606 to 611, error distribution uiformation is obtained from 
the quality indexes aaid the condensed feature vectors of the peured 
fingerprint image data. 

The quality index extraction means 505 calculates (at step 606) a 

IQ ciuality vector Q,j (i = 1, 2, . . ., N; 7 = 1, 2) of each (j = 1, 2) of i-th 

pair of images in the same way as described in connection with the skin 

pattern matching system of FIG. 1, according to following equations. 
f Vi j-.i \ 



15 



20 



25 



(36) 



QiJ.L J 



Qij.i = ^^QijAcy^^iicr (37) 

Here, q{jj{C) and ^/(C) (Z = 1, 2, . . X) axe C-th components of 
the ridge direction confidence vector and that of the principal compo- 
nent vector to be used for the KLT, respectively, as described in con- 
nection with eqv^^ltion (25). The quality vectors Q^j thus cedculated 
are supplied to the error distribution information analyzing means 506. 

On the other hand, the feature vector extraction means 501 ex- 
tracts (at step 607) feature vectors Uij (2 = 1,2,..., A^; j = 1, 2) from 
image data of i-th fingerprint. 

The vector transfer means 504 performs the KLT of the peiired 
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feaMirt^ vector Uij (at step 608), that is, performs the KLT according 
to foUowiiig equation (38) maldng use of L principal component vectors 
to obtain p^iired condensed feature vectors Vij. 
v,jj = ^\u,j (38) 



(39) 
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The paired condensed feature vectors Vij thus obtained axe also 
supphed to the error distribution information analyzing means 506. 
The error distribution information analyzing means 506 analyzes 
- correlation between the quality index and the error distribution refer- 
ring to quahty vectors Qij deliv(ired from tlie qutvlity index extraction 
15 . means 505 and the condensed feature vectors Vij dehvered from the 
vector transfer meiins 504, and prepares a lookup table, or an error 
distrubution table, representing relation between standard deviation 
of error values to ciuaJity index such as illustrated in FIG. 4 concerning 
each dimension of these vectors having the same L dimensions. More 
20 concret(ily, each time when a p<ur of condensed feature vectors Vij and 
correspondmg pair of quality vectors are dehvered, the error dis- 
tribution information analyzing meiuis 506 registers error value of of 
each component of the condensed feature vectors into a corresponding 
table entry prepared for each dimension according to ranks k of the 
25 qiuuitized quidity index value (at step 609), for CcUculating standard 
deviation auj of the error values for ecich rank k of each dimension / 
according to following equations, said error Vcdue being deviation of 
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each of components of the condensed feature vectors Vij from their 



mean value. 




where N^.j = ZQ,^.,€it 1, '^^u = ^ Zj Vijj, and 




Here, Nk,n^ number of data classified into each table entry, and 



spondin^' to quahty index value Qijj to be ciuantized into A>th rank. 
The error Vcilue cis above defined in eciuation (40) becomes difference 
between corresponding components of each pair of the condensed fea- 
ture vectors obtained from the same fingerprint, when the data set 
is composed of pciired (only two) image data. When more than two 
images from one fingerprint can be obtained, more precise mean value 
estimation, and hence, error value estimation can be obtained. There- 
fore, the morc.^ images are the more preferable. 

In the embodiment of FIG. 5, the error distribution information 
analyzing means 506 operates as follows. 

In advance, threshold values for quantizing each component of the 
quality v<u:t<)rs Q^j tivr d(^t(»viiiiu<Hl according to distribution of th(^ 
quality vectors Qij^ When Vcilue range of a dimension of the ciuality 
vector Qij is from Qmin to Q,nax, each of the threshold values ori, Qf2, 
. . cxn-i is determined so a^ to quantize the value range into n ranks, 
256, for example. Corresponding to each rank of each dimension, an 
error distribution table having n x L entries is prepared. 

The error distribution information analyzing means 506 compares 
(at step 610) each component Qi^ij of a quality vector Qn to the 



first sunuriation Hq. jj^ic means a simunation of concerning data corre- 
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threshold vidues or,- for obtaining corresponding rank ki i, tuid accumu- 
lates a sciltare error value (v;^,!,/ — v,-,2,/)^ of equation (41) calculating from 
corrc'spouding components of corresponding pair of condensed feature 
v(;(;t()rs v,-,i and Vi2 onto a ta])le entry indicated by tho rank The 
sam(? square eri'or vidue — 1;;.2,/)^ is also accumulated onto another 
(or the same) table entry indicated by ajiother rank k-zj obtained from 
partner quahty vector Qi -2- Thus, scpare error values of all dimensions 
of the pair of feature vectors cuad Vi^i a-re registered in the error 
distribution tcible. 

After finishing registration of the sciuare error values of all pairs 
of feature vectors iii the data set (determined at step 611), the error 
distribution information analyzing means 506 outputs the standcird de- 
viation cTkj of the eiTor values of each table entry calculated according 
to equation (41) as the error distribution information (at step 612)t 
When there is no data or only one square error value in a table entry, 
the equation (41) cannot be applied. In the case, a certain default Vcdue 
may be output, or a value interpolated from neiboring table entry may 
preferably output, when the ciuality index is ciuantized sufficiently fine, 
into 256, for example. 

Thus, the principal component vectors and the error distribution 
information previously described to be referred to by the first embod- 
iment of FIG. 1 of the sldn pattern matching system are analyzed. 

FIG. 7 is a graphic chart illustrating an analysis result, that is, 
an (experimental output representing standard deviation of errors of a 
dimension according to c^uahty index value. 

In the foregoing paragraphs, first embodiments of the skin pattern 
matching system iuid the sldn pattern feature cinalyzer are described, 
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wherein eigenv.d„e.s obtained along with ridge direction extraction are 
used as. the qruihty index. 

In the following paragraphs, second embodiments of the skin pat- 
tern matching system and the skin pattern featm-e analyzer are de- 
5 scribed, wherein the qiuility index is calculated according to a distance 
of a concerning feature vector from a proper distribution of feature 
vectors. 

First, principle of quality index measurement of the second em- 
bodiments is described. 

10 In the second embodiments, a reference measure is rehed upon a 

distance from a concerning feature vector to a closed space wherein 
feature vectors without noises are gathered. Representing^the closed 
space by a set of sample points, a distiuice to a nearest sample point 
is defined as the quahty index. 

15 In the following paragTaphs, principle.of quality index extraction 

is described first. 

Feature vectors obtained without noises from high-grade pattern 
images are localized in a certain closed part of a space having the 
same dimensions with those of the feature vectors. An example of 
20 the closed part is denoted by Q in FIG. 8 ilh.istrciting a space of the 
dimensions. Data samples of feature vectors having high-grade quality 
index without noises are represented by black dots in the closed space 

n. 

When there are sufficient number n, of the data samples in the 
25 closed space Q, distances between neighboring featiue vectors converge 
to zero. That is, foUowing equation stands with any feature vector xin 
the closed space Q. 
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lirn minlla; — t/l| = 0 (42) 
Consider a feature vector X, originally to be in the closed space 
Q when there is no noise, is extracted as another feature vector O of 
FIG. 8 from outside of the clo5>ed space Q because of niing;led noise 
5 V(;(;t()r iV. 

The quahty index defined in the second embodiments is a distance 
from a s<vmple point Y nearest to the concerning feature vector O, 
which is expressed i\s ||V — 0||. This distajice should be the Scune with 
the distance to the closed space Q when there are sufficient number of 

10 Scimple points. 

Hence, the distance to the closed space Q can be approximated by 
obtiiining a. minimum value of distances to feature vectors in a databaise 
where sufficient number of feature vectors without noise are prepared. 
Now, a concrete example of the second embodiments is described. 

15 In the second embodiments, following elements of FIG. 1 ai-e modi- 
fied, that is, the quality index extraction meeuis 106 or 505, the confi- 
dence attribution meaois 107, the error distribution information storing 
meaais 105, and the error distribution information analyzing mecins 506, 
and other elements are left unchanged. Furthermore, in the first em- 

20 bodirufnits of FIG. 1 and FIG. 5, the quality index extraction moaus 
106 or 505 is depicted to extract quahty indexes directly from image 
data. However, in the second embodiments, the quahty index extrac- 
tion means 106 or 505 is supphed with feature vectors after condensed 
through the KLT by the vector transfer meiins 10-3 or 505. 

25 FIG. 9 is a block diagram illustrating a quahty index extraction 

mecuis 90 according to the second embodiments, comprising a data- 
base 903 wherein a plurality of feature vectors without noise imd pro- 
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cessed through the KLT are prepared, a distance calculation means 
901 for calculating a distance between aai input feature vector and the 
phirality of feature vectors prepjured in the databiise 903, a distance 
rcvisif)u irifians 902 for revising/retaining a minimum value among the 

5 distances calculated by the distance calculation means 901, imd a con- 
trol means 904 for controUing above elements of the ciuality index ex- 
traction meajis 90. 

Now, operation of the quahty index extraction means 90 of the 
second embodiments is described. 

IQ FIG. 10 is a flowchart illustrating processes performed in the qual- 

ity index extraction means 90 of FIG. 9, comprising a feature vector 
distimce calculation step 1001, a minimum distcmce revision step 1002 
and a finish determination step 1003. 

First, a distance, namely a similarity of an input feature vector to 

15 that in the database 903 is calculated (at step 1001). 

In the databiise 903, the plurahty of high-quidity feature vectors 
are prepiured processed through the KLT. Although the high-ciuaUty 
may be discriminated by way of expert's eye, it can be preferably 
discriminated automatically referring to standard deviation of errors 

20 among at lefust two f<.'!ature vectors (after the KLT) tidveu fi-om the same 
fingerprint. Sets of feature vectors obtained from the sajne pattern 
images giving the standard deviation of errors smaller than a threshold 
value are selected to be of the high-quahty with few noises. As for the 
number of feature vectors, more than 10 thousands may be sufficient 

25 in the case of fingerprint. 

The distance of the input feature vector is calculated according to 
the Euchdean distance represented by equation (4), for example. 
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The distance revision means 902 revises a retcuining minimum value 
when Mk;' clistcuice newly calculated is smaller tluui the retciining min- 
imum value (at step 1002). 

The control means controls the quaUty index extraction means 90 
to repeat steps 1001 <md 1002 iintil distance Cidculation of an input 
feature vector to id\ the feature vectors registered in the database 903 
is finished (determined at step 1003). Thus, the distance of the input 
feature vector to the. set of reference data can be ccdculated to be output 
ius the quahty index Q. In the second embodiments, the quality index 
Q has a scaku- value, different from the quality index having vector 
v<vlue of the first embodiments. 

The second embodiment of the sldn pattern feature an^dyzer pre- 
pares the error distribution table making use of the quality indexes Q 
thus extracted by the quaUty index extraction means 90 from a data 
set havmg appropriate qucihty range. An error distribution information 
iinaly/ing means simihu" to the error distribution information analyzing 
means 506 of FIG. 5 may calcxilate the standard deviation of the error 
values according to equation (40) or (41) regarding each component 
Qijj hn.s the same vahie Qij for each paired feature vectors Vi,x and 

Here, the error distribution table is not necessary to be a 2- 
dimensional as illustrated in FIG. 4. The error distribution table of 
the second embodiments is sufficient to be 1-dimensional as illustrated 
in FIG. 11. An experimental result of the error distribiition table of 
FIG. 11 is shown <vs a gxaphic chart of FIG. 12 corresponding to that 
of FIG. 7 

The skin pattern matching .system of the second embodiment per- 
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fornLS skin pat torn matching verification medcing use of the qiicdity 
index Q bbtiiined by the quality index extraction means 90. The skin 
pattern matching verification preformed here is described also referring 
to FIG. 1. 

Pr(><;essings performed in the equality index extraction meems 106 
of FIG. 1 is executed by the quality index extraction means 90 in 
the second embodiment, whereto condensed feature vectors processed 
through the KLT are input from the vector transfer means 103, instead 
of source; feature vectors input chrectly from the feature extraction 
means 103 in the first embodiment. 

In the error distribution information storing means 106, the error 
distribution information is registered in a 1-dimensional error distribu- 
tion table. 

The confidence attribution means 107 outputs the standard devi- 
ation of errors referring to the 1-dimensional error distribution table in 
the quality index storing means 106 by accessing thereto with the scalar 
quality index Q obtained from the quality index extraction means 90 
corresponding to concerning feature vector v. 

Other processings are performed in the same way with the first 
emb()(lini(int, and duphcated descriptions are omitted. 

In the following paragraphs, third embodiments of the skin pattern 
matching system iuid the skin pattern feature tmalyzer is described, 
wherein a distance of a ridge hne pattern to a reference pattern is 
adopted ius the qucvlity index. 

FIG. 13 is a block diagram illustrating a configuration of the ciual- 
ity index extraction means 130 according to the third embodiments, 
comprising; 




a firsr., a second and a third direction pattern storing means 1301, 
1304 and" 1306, 

a distance calculation iriecuis 1302 for calculating distances be- 
twc(m input ridge direction patterns stored in r.he first direction pat- 
tern storing means 1301 and af&ne tnmsfen*ed ridge direction patterns 
stored in the third direction pattern storing means 1306 referring to 
their confidences stored therewith, respectively, 

a pjirameter revision means 1303 for determining whether the dis- 
tiiiice calculated by the distance calculation means 1302 is the shortest 
or not, and memorizing affine parameters when the distance is the 
shortest, 

an affine trcinsfer means 1305 for performing afline transfer of ridge 
direction patterns and their confidences stored in the first and the 
second direction pattern storing means 1301 and 1304, the obtained 
affine tr^msformations being stored in the third direction pcittern stor- 
ing meiins 1306, and 

a control means 1307 for controlling operation of each element of 
the quahty index extraction means 130 including parameter control of 
the affine transfer. 

FIG. 14 is a flowchart illustrating processes performed in the qual- 
ity index extraction mecuis 130 of FIG. 13, comprising cin affine transfer 
stej) 1401, a distance calculation step 1402, a distance/ciffine parameter 
revision step 1403, and a finish determination step 1404. 

Now, referring to FIG. 14, operation of the quality index extrac- 
tion means 130 of FIG. 13 according to the third embodiment is de- 
scribed. 

Ridge direction patterns 0{C) and their confidences q{C) such iis 
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prcvioiisly described in connection with the first embodiment of the 

skin pelt tern matching system are input to the first direction pattern 

storing moans 1301. In the second direction pattern storing means 

13()4, reference ridge direction patterns ©(C) and their confidences 

5 Q{C) arc stored. The refoirence ridge direction patterns 0(C) and 

their confidences Q{C) axe prepai'ed, for example, by obtaining mean 

Vcdues of n (10 thousajids, for example) sets of ridge direction patterns 

9^ (i = 1, 2, . ri) according to following equations. 

©x(C') = -Ecos(2/9,(C)) (43) 
i=i 

^° Qy{C) = ix:sin(2^,(C)) (44) 

n i=i 

Q(C) = v'e.cc)^ + e,(Cf - (46) 

The affine transfer means 1305 performs afiine transfer (at step 
15 1401) of direction patterns iind their confidences of <mi input pattern 
imiige stored in the first direction pattern storing means 1301 using 
affine parameter sets each determined according to each ensemble of 
parallel/rotation displacement values (Ax, At/, A5) in a search range. 
Th<^ affine tran.sfer is well known and described also in pp. 423- 
20 429 of the previous "Handbook of Image Analysis". Hence, detailed 
exi)lanation is omitted. However, it is to be noted here, in the affine 
transfer of the ridge direction pattern, that component values of the 
ridge direction jjatterns 0{C) ai'e defined relatively to the coordinate 
system and they are Vciriable when the coordinate system is such ro- 
25 tated <us in the affine transfer, deferently from ordinairy affine transfer 
of im^lges. Henc(j, for the rotcition A/9 of the coordinate system, A^ is 
add(.Hl to (.^acli comi^ment v^dne of the ridge direction patterns 0{C). 
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The obtained cvffine transformations are registered in the third 
direction' pat tojrn storing means 1306. The size of the affine trtmsfor- 
mations to be stored in the third direction pattern storing mecuis 1306 
are adjusted to be the same with the source ridge direction patterns 

5 in the first direction, pattern storing means 1301. Where there is no 
reference point, concerning confidence is set to be null. By prepar- 
ing the reference ridge direction patterns 0(C') and their confidences 
Q{C) to be stored in the second direction pattern storing means 1304 
to have larger sizes than ridge direction patterns of the input pattern 

JO image, pcU'ts having no reference point can be reduced and the transfer 
precision is improved. 

As for the search range of the pcirallel/ro tuition disi)lacement VcU- 
ues Ay, A^), it can be defined <xs follows, for example. When 

the ridge direction pattern <9(C') has a size of 16 x 16, as in this case, 

15 nine values -4, —3, . . +3, +4 are assigned for both the parallel dis- 
placements Aa: and A?/, and seven values —30'', —20*^, +20*", +30"* 
for the rotation displacement A/9. Thus, 9 x 9 x 7 = 567 displacement 
ensembles iire obtruned. Further, by applying the image center detec- 
tion method disclosed in the Provisional Publication No. 271884/'89 

20 l)<*for(^hiuul ni(nitiou(*d, tli(^ s(%irch raiig(^ can \n\ r(*dnc(*d arouncl the 
center of fingerprints for economizing computational time. 

The distance calculation means 1302 calculate the distance D (at 
step 1402) according to following equation for each ciffine pareimeter 

25 Zc<l{C)^nQ{C)r 
where, 

^,(C) = cos(2/9(C)) 
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OyiO = sin(25(C)) (49) 

Here,' F{*) represents the ciffine trtuisformation of *, and 7 is a 
pariurietdr having a vahie 0.5, for example. 

Th(; parameter revision means 1303 checks whether the distance 
D is th(? shorte.st for a concerning inpnt pattern image, cind registers 
the distiuice and vahies of the affine parameter set giving the distance, 
when it is found to be the shortest (at step 1403). 

The quality index extraction means 103 repeats steps 1401 to 
1403 for each tiffine parameter set in the parallel/rotation displacement 
range cidculating the distiuice D according to eciuation (47). When 
above repetition is finished (at step 1404) for a input pattern image, 
the revised rninimiim vcilue of the distance D is output iis the ciuality 
index. 

The third crnl)<)diments of the skin pattern matching .system and 
the sldii pattern analyzer are embodied by comprising the above de- 
scrib(?d (piaUty index extraction me^ms 130. The ciuaUty index output 
from the ciuidity index extraction means 130 has a scalar value and 
may be treated, in the same way with that obtained from the ciuality 
index extraction means 90 of FIG. 9 of the second embodiments of the 
invention, duphcated explanation being omitted. 

Further, by performing affine transfer of each input pattern im- 
age making use of the affine parameter set giving the shortest distance 
thereof, the input pattern image can be aligned in the coordinate sys- 
tem. Therefore, the affine transfer may be cipphed also in the first 
embodiments of the skin pattern matching system ivnd the slcin pat- 
tern analyzer for coordinate ahgnment of input data, that is, input 
image data or ridge direction data extracted as the feature vector. 
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Still fnit.li(;r, the affiiie f.rjuisfer is described to be performed each 
time witli.each aftine parameter set in the search rajige of the paral- 
lel/rotation displacements. However, a database may be beforehand 
prepared, wherein affine transformation data of all components of the 
ridge direction patterns for all displacements in the setuch range are 
registered. Then, the quahty index is extracted by calculating the dis- 
tance to cill the data registered in the database in the similar way with 
the quiility index extraction means 90 of FIG. 9 of the second embodi- 
ments. By pre-performing such time consuming processes as the affine 
transfer, calculation time cein be still reduced. 

In the fourth embodiment of the skin pattern matching system, 
the fingerprint matching verification is performed making use of cill 
or some of the three qucdity index extraction means 505, 90 and 130 
heretofore described, and commonly available parts are jointly used. 

FIG. 15 is a block diagram illustrating the fourth embocUment 
of the skin pattern matching system of the invention, wherein all the 
three quahty index extraction means are applied. 

Referring to FIG. 15, the skin pattern matching system of the 
fourth embodiment has a feature extraction section 151 for extracting 
feature data from sldn pattern images, a database section 12 for storing 
and mcinaging the feature data, a matching section 13 and a control 
section 14. 

The databiise section 12, the matching section 13 and the control 
section 14 may have the same configuration with those of FIG. 1, and 
so, duplicated description is omitted. 

The feature extraction section 151, which talces charge of out- 
putting a feature vector and standard deviation of estimated errors of 
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tui iui)Tit. skill i)Ht.t(;ni irniigc dat.H, comprises; 

ail image; input meiuis 1501 where image data of a skin pattern 
such ius a fingerprint or a pidm print are input, 

a ridge direction extraction means 1502 for extracting a ridge di- 
rection ijattern and its confidence from the image data input through 
the image input meajis 1501, 

a center detection means 1507 for detecting center of the image 
data input through the image input means 1501, 

a coordinate cJigiiment means 1508 for performing coordinate 
ahgnment of the ridge direction pattern and its confidence extracted 
by the ridge direction extraction means 1502, and for calculziting a 
first ciuahty index according to conformity obtiiined along with the 
coordinate ahgnment, 

- a principal coiiiponeiit vector storing mecUis 1503 wherein are pre- 
pared principle component vectors of distribution of vectors consist- 
ing of dir(;ction patterns processed by the coordinate aUgiiment means 
1508, 

a vector transfer meajis 1504 for generating a feature vector by 
performhig the KLT of the vector of the direction pattern processed 
by th(; coorflinate ahgnment means 1508 malcmg use of the principal 
component vectors prepared in the principal component vector storing 
meims 1503, 

a distance calculation means 1505 for obtaining a second quality 
index by calculating a minimum distance of the feature vector pro- 
cessed by the vector transfer means 1504 to a high-quahty data set of 
feature vectors beforehand prepared, 

a contribution calculation meaais 1506 for obtaining a third quality 
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index of (*ac:h dimonsion of the feature vector from its confidence ciligned 
by the corordinat.e alignment mecins 1508 cUid the principiJ component 
vectors, 

a first error distribution information storing means 1513 wherein 
standard deviation of errors of the feature vectors corresponding to the 
first ciuality index is prepared in a first lookup table, 

a second' error distribution information storing means 1514 
wherein standivrd deviation of errors of the feature vectors cori'espond- 
ing to the second quality index is prepared in a second lookup table, 

ci third error distribution information storing meaais 1515 wherein 
standard deviation of errors of the feature vectors corresponding to the 
third Cjuality index is prepared in a third lookup table, 

a first confidence attribution means 1509 for obtaining a first con- 
fidence- vahie to be attributed to the feature vector by referring to the 
first lookup table accessed with the first qu ah ty index, 

a second confidence attribution means 1510 for obtciining a second 
confidence value to be attributed to the feature vector by referring to 
the second lookup table accessed with the second quahty index, 

a third confidence attribution means 1511 for obtaining a third 
(;()nfi<l(mc(^ valu(^ to be attributed to the feature vector by ref<a*ring to 
the third lookup table accessed with the third quality index, and 

a confidence estimation means 1512 for output ting a confidence 
estimation of the feature vector according to the first, the second and 
the third confidence value. 

Now, operation of the fourth embodiment of the skin pattern 
matching system will be described referring to FIG. 15. 

Each of the above meeins except for the confidence estimation 
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means 1512 can be realized by applying each corresponding meaais 
heretofore, described in connection with the first to the third embodi- 
ments. Hence, these means other than the confidence estimation means 
1512 }ivv briefly described, here. 

The ridge direction extraction means 1502 extrexcts the ridge di- 
rection pattern and its confidence in the same way with the feature 
vector extraction means 101 and the quality index extraction means 
106 of FIG. 1, such as disclosed in the Provisional Publication No. 
7079/'9G. 

The coordinate alignment meaais 1508 outputs the first confidence 
indication obt^iined by calculating a distance of the ridge direction pat- 
tern to a reference pattern in the same way with the quality index ex- 
traction means 130 of FIG. 13, where the cUstance is a minimum value 
of D of equation (47) obtained when the ridge direction pattern is most 
fitted to the reference pattern by positioning the ridge direction pattern 
to th(^ r(^fer(Ui(:(^ i)attern. Here, search range of th(^ piiLrallel/rotcition 
displacement is set aroimd the center of the fingerprint detected by 
the center detection means 1507 such as disclosed in the Provisional 
Pubhcation No. 27i884/'89 beforehand mentioned. Further, position 
of the ridge direction pattern and its confidence are normcdized here 
by performing the affine transfer using the afEne parameter set giving 
the highest conformity. The coordinate ahgiiment means 1508 outputs 
the ridge direction pattern as a vector Vcilue expressed by equation (22) 
referred to in connection with the first embodiments. 

The vector transfer means 1504 performs the KLT of the vector 
output of the coordinate alignment means 1508 for outputting a feature 
vector according to equation (23) referring to the principal component 
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voicftors prepared in the principal component vector storing meeins 1503, 
in the safrie way with the vector trajisfer means 103 of FIG. 1. 

The distance calculation means 1505 outputs the second cxnality 
index obtained by calculating minimum distance of the feature vector 
5 to the high-qucvlity data set m the same way with the equality index 
extraction means 90 of FIG. 9 beforehand described in connection with 
the second embodiments. 

The contribution calculation means 1506 outputs the third quality 
index by calculating confidence value of the ridge direction pattern for 
j^O each component of the feature vector according to eciuation (25), in 
the Scime way with the quahty index extraction means 106 of FIG. 1 
described in connection with the first embodiments. 

The first, the second and the third confidence attribution means 
1509, 1510 and 1511 output the first, the second and the third con- 
is fidence value, respectively, for each component of the feature vector, 
obtained by referring to respective lookup table accessing with respec- 
tive quality index thus obtained of the feature vector. 

Contents of each of the first, second and the third lookup tables in 
the first, the second and the third error distribution information stor- 
20 ing mecuis 1513, 1514 and 1515 can be prepared in the same way £is 
described in connection with the third, the second or the first embodi- 
ments, respectively, by analyzing respective error distribution obtained 
through the coordinate ahgiiment means 1508, the distance calculation 
means 1505 or the contribution Ccilculation means 1506, respectively, 
from a data set of fingerprint images having an appropriate quality 



25 



range. 

The first, the second and the third confidence value being denoted 
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by throM' vectors V, '^cr and '^cr, respectively, tlie confideuce estima- 
tion mearis 1512 estimates the confidence estimation crfrom the three 
vectors ac cordin^Jt; to following equation. 

a, = ^ E ial (50) 
5 Here, /r.-represents an i-th component of the confidence estimation 

and ^(7i represents the i-the component of the first to the third 
confidence value •'(T,-. 

Or, otherwise, the confidence estimation ^-may be estimated as 
follows instead of abov« equation. 
10 di = max^cTi (51) 

3 

The confidence estimation means 1512 outputs the feature vector 
processed through the KLT and its confidence estimation <r cis output 
of the" feature extraction section 151. 

By applying the confidence estimation thus integrated from more 
15 than one ciuality index value, a better result can be obtained, demerits 
of each iudividucxi quaHty index being compensated, according to the 
fourth embodiment. 

In the following paragxaphs, a fifth embodiment of the sldn pattern 
matching system of the mvention will be described, wherein Fourier 
20 trimsformation of the sldn pattern image is applied to the feature vector 
extraction thereof. 

First, principle of the fifth embodiment is explained referring to a 
schematic dicigram of FIG. 16. 

In representatives of the fingerprint pattern, there are the Arch, 
25 the Loop, the Whorl and so on. These patterns have their own forms, 
and hence, 2-dimensional power spectrums of Fourier transformation 
thereof have their own features, as illvistrated in FIG. 16. 
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Referring to FIG, 16, al, bl and cl represent the Arch, the Loop 
ixiid the Whorl, respectively, a2, b2 and c2 representing characteristic 
parts of the Fourier power spectrums thereof (direct current, or zero 
frequency component, being set to their centers). 

5 In each of the Fourier power spectrums a2, b2 and c2, lower fre- 

quency components, that is, inner patterns, owe to uneven stamping, 
stamping pressure or backgTound of the fingerprint image and they are 
not significant for discriminating the fingerprint. The spectrum lines of 
horizontal and vertical zero frequency, that is, x7/-coordinate axis-like 

IQ lines, represent noises owing to discontinuity at end Hues of the image, 
and have no reference with the fingerprint discrimination. 

On the other hand, the higher frequency"components, that is, the 
outer patterns such cis 3-like pattern of the spectrum a2 or a ring 

- pattern of the spectrum c2, represent features concerning fingerprint 
ridge lines, and substantially. show following three characteristics. 

1. R.adial distance p of spectrum distribution center from the 
direct current component represents mean value of the ridge line pitch; 

2. Rotation direction </> of the spectrum distribution center repre- 
sents wh(itlier the fingerprint hixs right inclination or left inclination. 

20 ^' Whether the spectrum distribution is peak-hke or ring-like 

corresponds to arch-hke or whorl-hke of the fingerprint. 

Therefore, by sampUng most characteristic frequency bcmd from 
the Fourier power spectrum of the fingerprint pattern by filtering out 
unnecessary high frequency components and low frequency compo- 

25 nents, a feature value representing a whole fingerprint pattern can be 
extracted. 

Column charts a3, b3 cuid c3 of FIG. 16 schematicedly illustrate 
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feature values of respective fingerprint i)atterns cil, bl and cl sampled 
with a fixed frequency b<ind, namely, with a fixed radial distajice p 
around the direct current (0 < ^ < tt). 

Now, the fifth embodiment of the skin pattern matching system 

5 of the invention biised on the above principle is described. 

FIG. 17 is a block diagram illustrating a feature vector extraction 
means of the fifth embodiment corresponding the feature vector extrac- 
tion means 102 of FIG. 1, comprising a Fourier transfer means 1701 for 
performing Fourier transfer of a fingerprint image, a power calculation 

IQ means 1702 for calculating Fourier power spectrum of the Fourier trans- 
formation output of the Fourier transfer means 1701, a filtering meaais 

1703 for filtering the Fourier power spectrum, aaid a samphng means 

1704 for sampling characteristic spectrum components from output of 
the filtering means 1703 to be output as the feature vector. 

The slcin pattern matching system of the fifth embodiment com- 
I)rising the abov(j feature vector extraction means operates <\s follows. 

The Fourier transfer means 1701 performs digital Fourier transfer 
of the input 2'dimensional pattern image. As to the digital Fourier 
trcuisfer, it is well known and also described in pp. 5-11 of the "Haaid- 
20 book of Image Analysis", explanation thereof being omitted. Here, the 
fingerprint image is expressed by h{x,y)^ Fourier trajisfer thereof by 
F{h{x^y)) and Fourier components transferred by the Fourier transfer 
means 1701 by H{'u,v), where {o:,y) represents coordinates in the real 
space and (a, v) represents corresponding coordinates in the frequency 
25 domain. Hence, manipulation performed by the Fourier transfer means 
1701 is expressed by following equation. 

H{u,v)==F(h{x,y)) (52) 



BNSDOCID: <GB 23203S2A l_> 



- 56 - 



Tlio i>()wei- calcuhitioii me<uis 1702 calculate absolute value 
||f/'(a, i;)|| of the Fourier components H{u,v), obtained as a complex 
number, as follows. 

\\H{u,v)\\ = ^/^{H{u,v))■'-\-^{H{u,v))^ (53) 
5 wheroi ^{H{u,v)) cuid 'o=(JI(zi, v)) represent real part and imaginary 
pivrt of the Fouriojr components H(u,v), respectively. 

The filtering means 1703 performs, for example, convolution op- 
eration (Gatissicin filtering) middng use of well Icnown 2-dimensional 
Gaussian function G{u,v;(r), for filtering the Fourier power spectrum 
10 ||i?(tt,v)|| output of the Fourier transfer means 1702, as follows when 
filtered image data is expressed by J{u,v). 

Jiu,v) = i:i:G{p,q;a)\\H{u + p,v + q)\\ (54) 



15 



20 
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Here, the parameter a of the 2-dimensional Gaussian function may 
be set to be about "3 to 7 pixels (counted in the frequency domain), 
when the input image has 512 x 512 pixels. 

The samphng means 1704 samples pixel data of the filtered Fourier 
power spectrum J{u, v) in a frequency band defined by following equa- 
tions at cui appropriate interval d, as illustrated in a schematic diagram 
of FIG. 18. 

n < -{-v^ < r-i (56) 
V > 0 (57) 
In an example of the embodiment, a feature vector /is obtained 

from near 2{){) samples by setting ri = 20, r-2 = SO cuid the stunphng 

interval d fus 10 x 10. 

Size of the feature vector ||/|jrefiects signal intensity of the object 



25 
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finj^-erprint image, and so, can be used as the quality index of the 
feature vector /. 

Thus, the feature vector and its quality index are obtained in 
the fifth embodiment of the skin pattern matching system. Other 
component th<in the feature vector extraction meaais may be configiired 
in the same way with the first to the fourth embodiments heretofore 
described, by applying the above feature vector extraction means to 
the feature vector extriiction means 102 of FIG. 1, for extunple. 

In the embodiments heretofore described, the feature vector pro- 
cessed through the KLT is apphed for the skin pattern matching ver- 
ification or the sldn pattern ancdysis. However, the scope of this in- 
vention of the image feature analyzer and the image matching system 
is not limited in the feature vector processed through the KLT. As an 
example without the KLT, an embodiment making use of feature val- 
ues defined by singular points such as the cores and the deltas in the 
fingeri)riut will be described in the following paragTaphs. 

Maximum number of the cores and the deltas hi the fingerprint 
is usually found in the Whorl, wherein are found four singular points, 
two coro^s and two deltas. There can be defined aC-i = 6 segments 
connectmg these four smgiilar points. Therefore, 12 feature vsdues can 
be obtcuned, that is, 6 lengths of the 6 segments zind 6 numbers of ridge 
hnes crossing the 6 seg-ments. Further, each of the 12 feature value has 
each confidence value, as described in Uchida et al., previously referred 
to. These confidence values can be used for the quahty index (and 
Ccdled the quality index, hereafter). 

Therefore, following vectors can be defined from these feature val- 
ues iind their quality indexes. 
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feature value: v = 
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Vi 



\V12J 

Q2 



(58) 



quality index: q 



(59) 



Here, when there are found but less thaji four singular points as 
in the Loop, or when some singular points axe_.failed to be detected, 
corresponding components of the ciucdity vector v are substituted with 
a value out of bounds (—1, for example, when the confidence value is 
0 to 1). 

FIG. 19 is a bloclc diagxam illustrating a basic configiiration of the 
sixth embodiment of the skin pattern matching system, wherein the 
vector trimsfer meeuis 103 and the principal component vector storing 
means 104 are omitted compzured to the sldn pattern matching system 
of FIG. 1. 

Referring to FIG. 19, the sixth embodiment of the sldn pattern 
matching system hcis, 

a feature extraction section 191 comprising an image input means 
1901, a feature vector extraction means 1902, a error distribution infor- 
mation storing means 1904 and a confidence attribution means 1905, 
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H database section 12 comprising a data storing means 109 wherein 
prepared- the feature data extracted by the feature extraction section 
191, ajid a database management means 108 taldng chaxge of reference 
or registration of the feature data in the data storing means 109, 

a matching section 13 for performing the skin pattern matching 
verification to ontpnt matching results comprising a similarity calcula- 
tion means 110 for calculating a similarity of the feature data supphed 
from the feature extraction means 191 to each of the feature data stored 
in the database section 12, and a determination means 111 for deter- 
mining accordance/discordance from the similarity calculated by the 
similarity calcidation means 110, and 

a control section 14 for controlhng each of the above elements. 

The database management section 12, the matching section 13 
and the control section 14 operates in the same way with those of FIG. 
1, and so, operation of the feature extraction section 191 is described, 
here. 

The feature vector extraction means 1902 extracts the feature vec- 
tor ^according to equation (58) as above described referring to the 
singailax points of the cores and deltas. 

The quality index extraction means 1904 extracts the quality vec- 
tor q according to equation (59). 

In the error distribution information analyzing mecms 1903, there 
is prepared a lookup table wherein registered stcuidcixd deviation of 
errors <7,-(ry,) of components Vi of each dimension of the featiu*e vector 
V. When the quality index value is that of out of bound, -1, because of 
missing data, a fixed value is registered there. As for the fixed value, 
it is sufficient to be- more than 1000 times of the ordinary standard 




deviation, or zero when inverse standard deviation is registered in the 
lookup table. 

The confidence attribution means 1905 outputs a confidence vector 
crhy referring to the lookup table in the error distribution information 
analyzing means 1903 by accessing thereto with the quality vector q. 

Then, the same procedure follows as beforehajid described in con- 
nection with the first embodiment of the sldn pattern matching system. 

The lookup table in the error distribution information analyzing 
means 1903 is prepared by a fourth embodiment of the skin pattern 
feature analyzer, whereof a block diagram is illustrated in FIG. 20. 

Referring to FIG. 20, the sldn pattern analyzer of the fourth em- 
bodiment comprises a featiure vector extraction means 2001, a quality 
index extraction means 2002 and an error distribution information an- 
alyzing means 2003. 

The feature vector extraction means 2001 extracts feature vectors 
vfrom a data- set of a plurality, 10 thousands, for example, of paired 
images according to eqiiation (58). The quality index extraction means 
2002 extracts quality vectors q from the data set according to equation 
(59). 

The error distribution information analyzing means 2003 prepares 
a 2-climensional lookup table by calculating error distribution for each 
quzintized ciuality index value of each dimension, analyzing the error 
distribution in the same way with the error distribution information 
analyzing means 506 of FIG. 5. Here, data corresponding to the quality 
index value out of boimds, -1, axe omitted from the accumulation 
operation regarded as defect data. 

Thus, the skin pattern feature analyzer and the skin pattern 
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matching system of high-precision can be embodied even without the 
KLT. 

In the embodiments heretofore described of the invention, match- 
ing of one fingerprint is discussed. However, it can be easily understood 
that the present invention Ccin be apphed to the Ten Print Caxd. 

When applying to the Ten Print Card, the operation for one fin- 
ger as heretofore described may be repeated ten times for each of ten 
fingers, preparing data of feature vectors and confidence vectors for ten 
fingers in the database section and so on. 

Further, the condensed feature vectors (5-dimensionaI, for exam- 
ple,) processed through the KLT of ten fingers may be integrated into, 
a 50-dimensional feature vector, and may be condensed again through 
the KLT- Applying upper one or two dimensions thereof, the data 
amount to be -treated of ten fingers may be still reduced. As for con- 
fidence value in the Ccise, equation (25) caxi be applied by obtaining 
quality value q{C) from confidence vector of each finger, for example. 

Thus, by repeating the KLT for whole card data, discrimination 
performance can be still improved without increasing dimension num- 
ber of fccLture values. Further, treating the whole card data is especially 
effective in the Ccise matching verification operation is finished when 
similarity distance accumulation attains to a threshold value, since dis- 
cordant card data can be rejected in earher stage of the operation by 
treating the whole caxd data at the same time. 

Heretofore, the present invention is described mainly in connection 
with embodiments applied to fingerprint identification. However, it 
goes without saying that there are many applications or modifications 
in the scope of the invention. For example, the invention c^ui be applied 
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just the same way to the palm print identificatiotL In the palm print, there are 
four delta parts at each finger base except the thumb, as illustrated in Fig. 21. 
Therefore, by cutting out 512 x 512 pixel data of 500 dpi of the deltas from a 
paper stamped with a palm print, they can be treated as a four fingerprint card, 
instead of the Ten Print Card. 

Each feature disclosed in this specification (which term includes the claims) 
and/or shown in the drawings may be incorporated in the invention independently 
of other disclosed and/or illustrated features. 

The text of the abstract filed herewith is repeated here as part of the 
specification: 

For providing an efficient image pattern matching system, an image feature 
extractor (11) of the invention comprises a feature vector extraction means (101) 
for extracting a feature vector from the pattern image, a quality index extraction 
means (106) for extracting quality index information of the pattern image, an error 
distribution information representing correlation between error distribution of the 
feature vector and the quality index information is prepared, and a confidence 
attribution means (108) for obtaining confidence estimation information referring 
to the error distribution information retrieved with the quality index information. 
The image feature analyzer (51) prepares the error distribution information. An 
image feature matching system identifies feature information of an image pattern 
extracted by the image feature extractor (1 1) by comparing it to registered feature 
information. 
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CXAIMS: 



1. 



A system for collating images comprising: 



means for deriving a feature value for the features of each image; 

means for deriving a quality index value for the features of each image; 

means for determining errors for the feature values in which said errors are 
adaptively measured according to the quaUty index of the features of each image; 
and 

means for determining the extent of ectypography between features of each 

image, 

2. A system for collating images according to claim 1, in which said means 
to determine the extent of ectypography between features of each image 
comprises: 

means for considering the confidence of the feature values between image 
features; 

means for analysing the two images by considering the confidence of the 
feature values and for referring to the errors for the featmre values for the two 
image features; and 

means to refer to said errors for the feature values to determine if one 
feature is an ectype of a feature in another image. 

3. An system according to claim 1 or 2, further comprising 
an image feature extractor means; 

a index quality extraction means for extracting the quality of the index 
information of a pattern image; 

an image feature analyzer which prepares error distribution information 
representing correlation between error distribution of the feature vector and the 
quality index information; 

a confidence attribution means for obtaining confidence estimation 
information referring to the error distribution information retrieved with the qxiality 
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index information; and 

which identifies the feature infomiation of an image pattern extracted by the image 
feature extractor by comparing it to registered feature information. 

4. An image feature extractor for a system according to any preceding claim, 
wherein said image feature extractor outputs a feature information data set of a 
pattern image including data of a feature vector of the pattem image and 
confidence estimation information of the feature vector attributed to each 
component of the feature vector, said image feature extractor comprising; 

a feature vector extraction means for extracting the feature vector from the 
pattem image; 

at least one quality index extraction means for extracting quality index 
information of the pattem image; 

at least one error distribution storing means, coiresponding to each of said 
quality index extraction means, wherein error distribution information is prepared, 
said error distribution information representing correlation between the error 
distribution of a plurality of feature vectors and the quality index information 
corresponding to said quality feature vectors; 

a confidence attribution means, each corresponding to each of said error 
storing means for obtaining confidence information referring to said error 
distribution information; and 

a confidence estimation means for providing confidence estimation 
informatiorL 

5. An image feature extractor according to claim 4, wherein if only one 

quality index extraction means is provided, said confidence information is output 
as said confidence estimation information; and if a plurality of quality index 
extraction means is provided, said confidence estimation information is provided 
by integrating said confidence information obtained by each of said confidence 
attribution means. 



-65 - 

6. An image feature extractor for a system according to any of claims 1, 2 or 
3, for outputting a feature information data set of a pattern image including data 
of a feature vector of the pattern image and confidence estimation information of 
the feature vector attributed to each component of the feature vector, said image 
feature extractor comprising: 

a feature vector extraction means for extracting the feature vector from the 
pattern image; 

at least one quality index extraction means for extracting quality index 
information of the pattern image; 

error distribution information storing means, each corresponding to each 
of said quality index extraction means, wherein error distribution information is 
prepared, and represents the correlation between the error distribution of a plurality 
of feature vectors and the quality index information corresponding to said plurality 
of feature vectors; and 

confidence attribution means, each corresponding to each of said error 
distribution information storing means for obtaining confidence information 
referring to said error distribution information prepared in on of said error 
distribution storing means by way of said quality index information, said 
confidence information being output as the confidence estimation if only one 
quality index extraction means is provided and if a plurality of quality index 
extraction means are provided, said confidence estimation information is provided 
by integrating said confidence information obtained by each of said confidence 
attribution means. 

7. An image feature analyzer for a system according to any of claims 1, 2 or 
3, wherein said image featxne analyzer obtains error distribution information 
representing correlation between the error distribution of a plurality of feature 
vectors and the quality index information corresponding to said plurality of feature 
vectors, said image feature analyzer comprising: 

a feature vector extraction means for extracting the pliuality of feature 
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vectors from pattern images; 

an index qiiality extraction means for extracting the quality of the index 
information of the pattern image; and 

a error distribution information analysing means for calculating the error 
distribution information from the error distributed among each feature vector set 
of the plurality of feature vectors and a value of the quality index information of 
each feature vector belonging to each feature vector set, said feature vector sets 
comprising feature vectors extracted from a pliurality of pattern images of the same 
pattern. 

8. An image collating system according to claim 1, in which said means for 
determining the extent of ectypography between image features is performed using 
a feature information data set of an image pattern including a feature vector of the 
image pattern and confidence information of the feature vector attributed to each 
component of the feature vector, said image collating system further comprising: 
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a databcise section wherein the feature information data set of each 
of a pluraUty of pattern images is registered; and 

a oollatiJTg section to determine the degree of ect^/po&raphy between the pattern 

10 . image by discriminating accordcince/discordcince of the 

feature information data set of the pattem image with each of 
the feature information data set registered in said database 
section according to distance between two feature vectors each 
inchided in respective feature information data set calculated 

15 in consideration of the confidence information of the two fea- 

ture vectors. 

9. The imcige feature extractor recited in claim 6^ said feature 
vector extraction means comprising ct primary feature vector extraction 
means for extracting the feature vector of the pattern image of a skin 
pattern by extracting ridge direction information of each sub-region-of 

5 the pattern image. . 

'^0. The image feature extractor recited in claim 6, said feature 
vector extraction means comprising a primary feature vector extraction 
means for extracting the feature vector from the pattem image of a 
fingerprint pattern by extracting information of distances and ridge 

5 line numbers between every two of sing*ular points of the fingerprint 
pattern. 

11. The image feature extractor recited in claim 6, Scvid feature 
vector extraction means comprising a primary feature vector extraction 
means for extracting the feature vector from the pattern image by 
samphng discrete Fourier power spectrums in a certain frequency band, 
5 said discrete Fourier power spectrums being obtained by performing 
discrete Foiu-ier transfer of said pattern image. 
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12. The image feature extractor recited in claim 9 or claim io, said 
feature vector extraction means further comprising at least one vector 
transfer means each transferring the feature vector making use of a 
paiameter set. 

13. The image feature extractor recited in claim 12, one of said 

vector transfer means transferring the feature vector maldng 
use of a parameter set comprising at lea^t one of primary principal 
comj^onent vectors of distribution of feature vectors each obtained from 
5 a data set of ci plurality of pattern images in the same way with the 
feature vector. 

14. The image feature extractor recited in claim 12, one of said 

vector trcuisfer means performing affine transfer of the feature 
vector maldng use of each of a plurality of parameter set defined in a 
certain search range and outputting an affine transformation of the 

5 feature: vector giving a minimum disUmce to a reference feature vector. 

15. The image feature extractor recited in claim 11, said featiu-e 
vector extraction means further comprising a vector transfer means for 
transferring the feature vector maldng use of a parameter set compris- 
ing at lecist one of primary principal component vectors of distribution 

5 of features vectors oiach obtained from a data set of a plurality of pattern 
images in the same way with the feature vector. 

16. The image feature extractor recited in claim 14, one of said at 
least one quality index extraction means extrcicting said quality index 
information according to said minimum distance. 

17. The imcige feature extractor recited in claini .6; one of said 

quality index extraction me^uis extracting said quality index 
information according to a minimum value among distances of the 
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feature vector to a set of reference feature vectors each obtained from 
5 a high-quality pattern image in the same way with the featiure vector. 

Tho image feature extractor recited in chum 9, one of said at 
loiust one quahty index extraction means extracting said CiUcility index 
information according to confidence of said ridge direction information 
of each sub-region of the pattern image. 

19, The image feature analyzer recited in claim 7, said feature 
vector extraction means extracting each of the plurality of feature vec- 
tors from each of the pattern images of skin patterns by extracting 
ridge direction information of each sub-region of respective each of the 

5 pattern images. 

20. The image feature analyzer recited in claim 7, said feature vec- 
tor extraiction means extracting each of the plurahty of featiue vectors 
from each of the pattern images of fingerprint patterns by extracting 
information of distaoices and ridge Une numbers between every two of 

5 singular points of respective each of the plurahty of fingerprint pat- 
terns, 

21- The image feature analyzer recited in claim/ 7, said feature vec- 
tor extraction means extracting each of the plurahty of feature vectors 
from each of the pattern images by samphng discrete Foiurier power 
spectriuns in a certain frecj[uency band, said discrete Fourier power 
5 spectrums being obtained by performing discrete Fourier transfer of 
respective each of said pattern images. 

22. The image feature analyzer recited in claim 19, or claim 20, 
said feature vector extraction means further comprising at lea^t one 
vector trcuisfer means each transferring the plurality of feature vectors 
making use of a parameter set. 
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23. The image feature analyzer recited in claim 22, one of said at 
least one vector transfer means transferring the plurality of feature vec- 
tors maldng use of a parameter set comprising at least one of primary 
principal component vectors of distribution of feature vectors each ob- 

5 tained from a data set of a plurality of pattern images in the same way 
with the plurality of the feature vector. 

24. The image feature analyzer recited in claim .22, one of said at 
least one vector transfer means performing affine transfer of the plu- 
rality of feature vectors making use of each of a plurality of parameter 
set defined in a certain search range and outputting an aJB&ne trans- 

5 formation of each of the plurality of feature vectors giving a minimum • 
distance to a reference feature vector. 

25. The image feature analyzer recited in claim^ 21, said feature 
vector extraction means further cornprising a vector transfer means for 
transferring the plurality of feature vectors making use of a parameter 
set comprising at least one of primary principal component vectors 

5 of distribution of feature vectors each obtained from a data set of a 
plurality of pattern images in the same way with the plurality of feature 
vectors. 

26. The iniag(j feature aui.ilyz(;r recited in cbuni 2A, sixid qucd- 
ity index extraction means extracting said quality index information 
according to said minimum distance. 

27. The image feature analyzer recited in claim 7, said quality 
index extraction means extracting said quality index information ac- 
cording to a minimum value among distances of each of the plurality 
of feature vectors to a set of reference feature vectors each obtained 

5 from a high-quahty pattern image in the same way with the plurality 

BNSDOCID: <GB 2320352A_I_> 



- 71 - 

of feature vectors. 

38. 'The image feature analyzer recited in claim ^9, said qual- 
ity index extraction means extracting said quality index information 
according to confidence of said ridge direction information of each sub- 
region of said pattern images. 

29. image feature oollatii^g system 

making use of a feature information data set taken fran a person 
including a feature vector and confidence information of the feature 
vector attributed to each component of the feature vector; said image 
ooiiatiJTg system comprising a database section wherein the fea- 

ture information data set of each of a pku-ality of persons is registered, 
ajid a coiiatiiTg .section for identifying the person by discriminating ac- 
cordance/discordance of the feature information data set of the person 
to each of feature information data sets registered in said database sec- 
tion according to distajice between two feature vectors each included 
in respective feature information data -set calculated in consideration 
of the confidence information of the two feature vectors, wherein: 

said fectture vector included in each of the feature information 
data set taken form the person and said feature information 
data sets prepared in said database section is obtained through 
Karhunen Loeve transfer of more thaji one featiue vector each 
obtained through Karhunen Loeve transfer of a feature vector 
extracted from a slcin pattern image of a different fixed part of 
each respective person. 
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30. A method for collating images comprising the steps of: 
detemiining feature values for image features; 
deriving qxiality index values for image features; and 

detemiining the extent of ectypography between each image by considering 
the confidence between the features of each image and referring to the errors for 
the feature values for the two images wherein said errors are adaptively measured 
according to the quality index of the features of the images. 

31. A method of or apparatus for collating images and determining the extent 
of ectypography between images substantially as described hereinbefore and as 
illustrated by the accompanying drawings. 
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